Electronic device and method for generating thumbnail data

ABSTRACT

An electronic device includes a first image sensor, a second image sensor, one or more image processing modules, and a display. The first image sensor generates first image data. The second image sensor generates second image data. The one or more image processing modules process one or more image data among the first image and the second image data. The display displays the one or more image data among the first image data or second image data processed by the one or more image processing modules. The thumbnail generation module generates thumbnail data using the one or more image data among the first image data and second image data processed by the one or more image processing modules. A method includes converting the plurality of image data into a format displayable on a display, and generating thumbnail data using the image data of the displayable format.

PRIORITY

The present application is related to and claims priority under 35U.S.C. §119(a) to a provisional application Ser. No. 61/780,635 filed inthe United States Patent and Trademark Office on Mar. 13, 2013 and anapplication No. 10-2014-0025000 filed in the Korean IntellectualProperty Office on Mar. 3, 2014, the contents of which are hereinincorporated by reference.

TECHNICAL FIELD

Various embodiments of the present disclosure relate to a method forprocessing images and an electronic device thereof.

BACKGROUND

With the development of Information Telecommunication (IT) technologiesand semiconductor technologies, a variety of kinds of electronic devicesare evolving into multimedia devices providing various multimediaservices. For example, a portable electronic device can provide variousmultimedia services such as a broadcasting service, a wireless Internetservice, a music playing service and the like.

An electronic device can provide various services using one or moreimages acquired through image sensors. For example, the electronicdevice can perform image processing such as level adjustment, noiseremoval, gamma correction, color space conversion and the like for imagedata acquired through the image sensor, using an Image Signal Processor(ISP), and provide various services.

However, because the electronic device performs various image processingusing one ISP, there can be a problem of decreasing a processing speedfor image data.

SUMMARY

To address the above-discussed deficiencies, it is a primary objectprovide an apparatus and method for efficiently processing image dataacquired through one or more image sensors in an electronic device.

An embodiment of the present disclosure can provide an apparatus andmethod for reducing a processing delay of image data acquired throughone or more image sensors in an electronic device.

An embodiment of the present disclosure can provide an apparatus andmethod for efficiently generating thumbnail data about capture imagedata in an electronic device.

An embodiment of the present disclosure can provide an apparatus andmethod for generating thumbnail data about capture image data using aprocessor different from an image processing unit (i.e., Image SignalProcessor (ISP)) in an electronic device.

An embodiment of the present disclosure can provide an apparatus andmethod for generating thumbnail data about capture image data using oneor more data generated in an image processing unit (i.e., ISP), in adifferent processor of an electronic device.

An embodiment of the present disclosure can provide an apparatus andmethod for interlocking and storing thumbnail data generated using aprocessor different from an image processing unit (i.e., ISP) andcapture image data in an electronic device.

An embodiment of the present disclosure can provide an apparatus andmethod for interlocking and storing capture image data and thumbnaildata using metadata generated in an image processing unit (i.e., ISP) ina different processor of an electronic device.

The above aspects are achieved by providing an electronic device andmethod for processing an image.

According to an embodiment of the present disclosure, an electronicdevice includes a first image sensor, a second image sensor, one or moreimage processing modules, a display, and a thumbnail generation unit.The first image sensor generates first image data. The second imagesensor generates second image data. The one or more image processingmodules process one or more image data among the first image and thesecond image data. The display unit displays the one or more image dataamong the first image data and second image data processed by the one ormore image processing modules. The thumbnail generation module generatesthumbnail data using the one or more image data among the first imagedata and second image data processed by the one or more image processingmodules.

According to an embodiment of the present disclosure, an electronicdevice includes one or more processors and a display unit. The one ormore processors receive image data, process the image data, and generatea preview image. The display unit displays the preview image generatedby the one or more processors. The one or more processors are configuredto generate an image of a smaller size than the preview image using atleast part of the preview image, in response to a signal correspondingto a capture instruction.

According to an embodiment of the present disclosure, an operationmethod of an electronic device is provided. The method includes theoperations of generating a plurality of image data using a plurality ofimage sensors, converting the plurality of image data into a formatdisplayable on a display unit through one or more image processingmodules, and generating thumbnail data using the image data of thedisplayable format converted in the image processing modules, in a othermodule separate from the image processing modules.

According to an embodiment of the present disclosure, an operationmethod of an electronic device is provided. The method includes theoperations of storing one or more image data, converting one or moreimage data among the one or more image data into a preview image throughone or more processors, and, in response to a signal indicating acapture instruction, generating an image of a smaller size than thepreview image using at least part of the preview image through theprocessor.

According to an embodiment of the present disclosure, an electronicdevice includes one or more image sensors and an interface. The one ormore image sensors generate image data. The interface processes theimage data generated in the one or more image sensors. The interfacetransmits the image data to one or more modules. The one or more moduleschange a format of the image data based on an image data processingmethod of a corresponding module.

Before undertaking the DETAILED DESCRIPTION below, it may beadvantageous to set forth definitions of certain words and phrases usedthroughout this patent document: the terms “include” and “comprise,” aswell as derivatives thereof, mean inclusion without limitation; the term“or,” is inclusive, meaning and/or; the phrases “associated with” and“associated therewith,” as well as derivatives thereof, may mean toinclude, be included within, interconnect with, contain, be containedwithin, connect to or with, couple to or with, be communicable with,cooperate with, interleave, juxtapose, be proximate to, be bound to orwith, have, have a property of, or the like; and the term “controller”means any device, system or part thereof that controls at least oneoperation, such a device may be implemented in hardware, firmware orsoftware, or some combination of at least two of the same. It should benoted that the functionality associated with any particular controllermay be centralized or distributed, whether locally or remotely.Definitions for certain words and phrases are provided throughout thispatent document, those of ordinary skill in the art should understandthat in many, if not most instances, such definitions apply to prior, aswell as future uses of such defined words and phrases.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the present disclosure and itsadvantages, reference is now made to the following description taken inconjunction with the accompanying drawings, in which like referencenumerals represent like parts:

FIG. 1A is a diagram illustrating a network environment including anelectronic device according to an embodiment of the present disclosure;

FIG. 1B is a block diagram illustrating an electronic device accordingto an embodiment of the present disclosure;

FIG. 2 is a detailed block diagram illustrating a processor according toan embodiment of the present disclosure;

FIG. 3 is a block diagram illustrating an electronic device according toanother embodiment of the present disclosure;

FIG. 4 is a detailed block diagram illustrating a processor according toanother embodiment of the present disclosure;

FIG. 5 is a block diagram illustrating an electronic device according toa further embodiment of the present disclosure;

FIG. 6 is a detailed block diagram illustrating a processor according toa further embodiment of the present disclosure;

FIG. 7 is a detailed block diagram illustrating an external imageprocessing unit according to an embodiment of the present disclosure;

FIG. 8 is a detailed block diagram illustrating a memory according to anembodiment of the present disclosure;

FIG. 9 is a block diagram illustrating an interface according to anembodiment of the present disclosure;

FIG. 10 is a flowchart illustrating a procedure for generating thumbnaildata in an electronic device according to an embodiment of the presentdisclosure;

FIG. 11 is a flowchart illustrating a procedure for interlocking andstoring thumbnail data and capture image data in an electronic deviceaccording to an embodiment of the present disclosure;

FIGS. 12A and 12B are diagrams illustrating a structure of divided andstored image data according to an embodiment of the present disclosure;and

FIG. 13 is a block diagram illustrating an electronic device accordingto a further embodiment of the present disclosure.

DETAILED DESCRIPTION

FIGS. 1A through 13, discussed below, and the various embodiments usedto describe the principles of the present disclosure in this patentdocument are by way of illustration only and should not be construed inany way to limit the scope of the disclosure. Those skilled in the artwill understand that the principles of the present disclosure may beimplemented in any suitably arranged electronic devices. The presentdisclosure can be described herein below with reference to theaccompanying drawings. The present disclosure can make variousmodifications and can have various embodiments. Specific embodimentshave been exemplified in the drawings and a related detailed descriptionhas been disclosed. But, these do not intend to limit the presentdisclosure to a specific embodiment form, and should be understood asincluding all changes, equivalents or alternatives included in thespirit and technical scope of the present disclosure. In a descriptionof the drawings, like reference numerals are used for like constituentelements.

The expressions such as “comprise”, “include”, “can include”, “cancomprise” or the like usable in the present disclosure indicate theexistence of disclosed corresponding function, operation, constituentelement and the like, and do not limit additional one or more functions,operations, constituent elements or the like. Also, in the presentdisclosure, it should be understood that terms of ‘comprise’, ‘include’,‘have’, etc. are to designate the existence of a feature disclosed inthe specification, a numeral, a step, an operation, a constituentelement, a part, or a combination thereof, and do not previously excludea possibility of existence or supplement of one or more other features,numerals, steps, operations, constituent elements, parts, orcombinations thereof.

In the present disclosure, the expressions of “or” and the like includeany and all combinations of words arrayed together. For example, “A orB” can include A, or can include B, or can include all of A and B.

In the present disclosure, the expressions of “first”, “second” and thelike can modify various constituent elements of the present disclosure,but do not limit the corresponding constituent elements. For example,the expressions do not limit the order and/or importance and the like ofthe corresponding constituent elements. The expressions can be used todistinguish one constituent element from another constituent element.For example, a first user device and a second user device are all userdevices, and represent different user devices. For example, a firstconstituent element can be named as a second constituent element withoutdeparting from the spirit and scope of the present disclosure. Likely,even a second constituent element can be named as a first constituentelement.

When it is mentioned that one constituent element is ‘connected’ or‘accessed’ to another constituent element, it should be understood thatone constituent element can be directly connected or accessed to anotherconstituent element or the third constituent element may exist inbetween the two constituent elements. In contrast, when it is mentionedthat one constituent element is ‘directly connected’ or ‘directlyaccessed’ to another constituent element, it should be understood thatthe third constituent element does not exist in between the twoconstituent elements.

The terms used in the present disclosure are used for just describingspecific embodiments, and do not intend to limit the spirit and scope ofthe present disclosure. The expression of singular number includes theexpression of plural number unless clearly intending otherwise in acontext.

Unless defined otherwise, all terms used herein including atechnological or scientific term have the same meaning as being commonlyunderstood by a person having ordinary knowledge in the art to which thepresent disclosure belongs. Terms as in defined in a general dictionaryshould be interpreted as having a meaning consistent with a contextualmeaning of a related technology, and are not interpreted as an ideal orexcessively formal meaning unless defined clearly in the presentdisclosure.

An electronic device according to an embodiment of the presentdisclosure can be a device including a camera function. For example, theelectronic device can include at least one of a smart phone, a tabletPersonal Computer (PC), a mobile phone, a video phone, an electronicbook reader, a desktop PC, a laptop PC, a netbook computer, a PersonalDigital Assistant (PDA), a Portable Media Player (PMP), an MPEG AudioLayer 3 (MP3) player, a mobile medical instrument, a camera, and awearable device (e.g., a Head Mount Display (HMD) such as electronicglasses, an electronic clothes, an electronic bracelet, an electronicnecklace, an electronic accessory, an electronic tattoo, or a smartwatch).

According to some embodiments, the electronic device can be smartelectric home appliances with a camera function. For example, the smartelectric home appliances can include at least one of a television, aDigital Versatile Disc (DVD) player, an audio, a refrigerator, an airconditioner, a cleaner, an oven, a microwave, a washing machine, an aircleaner, a settop box, a TV box (for example, Samsung HomeSyn™,AppleTV™, or Google TV™), a game console, an electronic dictionary, anelectronic locking system, a camcorder, and an electronic frame.

According to some embodiments, the electronic device can include atleast one of various medical instruments (e.g., Magnetic ResonanceAngiography (MRA), Magnetic Resonance Imaging (MRI), ComputerizedTomography (CT), a moving-camera, an ultrasound machine and the like), anavigation device, a Global Positioning System (GPS) receiver, a vehicleinfotainment device, a vessel electronic equipment (e.g., a vesselnavigation device, a gyrocompass and the like), a flight electronicinstrument, a security instrument, and an industrial or household robot.

According to some embodiments, the electronic device can include atleast one of part of furniture or building/structure with a camerafunction, an electronic board, an electronic signature input device, aprojector, and various metering instruments (e.g., tap water,electricity, gas or radio wave metering instrument and the like). Theelectronic device according to the present disclosure can be one of theaforementioned various devices or a combination of two or more. Also, itis obvious to those skilled in the art that the electronic deviceaccording to the present disclosure is limited to the aforementionedinstruments.

Electronic devices according to various embodiments will be describedbelow with reference to the accompanying drawings. The term of ‘user’used in the various embodiments can denote a person who uses anelectronic device or a device (e.g., a fuzzy electronic device) whichuses the electronic device.

Below, embodiments of the present disclosure describe a technology forprocessing image data acquired through a plurality of image sensors inan electronic device.

FIG. 1A is a diagram illustrating a network environment 100 including anelectronic device according to an embodiment of the present disclosure.

Referring to FIG. 1A, the electronic device 101 can include a bus 110, aprocessor 120, a memory 130, an input/output interface 140, a display150, a communication interface 160, an image processing module 170, andan image sensor module 180.

The bus 110 can be a circuit connecting the aforementioned constituentelements with each other, and forwarding a communication signal (e.g., acontrol message) between the aforementioned constituent elements.

The processor 120 can receive an instruction from the aforementionedother constituent elements (e.g., the memory 130, the input/outputinterface 140, the display 150, the communication interface 160, theimage processing module 170, or the image sensor module 180), forexample, through the bus 110, deciphers the received instruction, andexecute operation or data processing according to the decipheredinstruction.

The memory 130 can store an instruction or data which is received fromthe processor 120 or the other constituent elements (e.g., theinput/output interface 140, the display 150, the communication interface160, the image processing module 170, the image sensor module 180 or thelike) or is generated by the processor 120 or the other constituentelements. The memory 130 can include programming modules of a kernel131, a middleware 132, an Application Programming Interface (API) 133,an application 134 or the like. The aforementioned respectiveprogramming modules can be composed of software, firmware, hardware or acombination of at least two or more of them.

The kernel 131 can control or manage system resources (e.g., the bus110, the processor 120, the memory 130 or the like) used for executingoperations or functions implemented in the remnant other programmingmodules, for example, the middleware 132, the API 133, or theapplication 134. Also, the kernel 131 can provide an interface ofenabling the middleware 132, the API 133, or the application 134 toaccess and control or manage an individual constituent element of anelectronic device 101.

The middleware 132 can perform a relay role of enabling the API 133 orthe application 134 to communicate and exchange data with the kernel131. Also, in relation with work requests received from the application134, the middleware 132 can perform a control (e.g., scheduling or loadbalancing) of the work request using a method of allotting priorityorder and the like capable of using a system resource (e.g., the bus110, the processor 120, the memory 130 or the like) of the electronicdevice 100 to at least one application among the application 134, forexample.

The API 133, which is an interface for enabling the application 134 tocontrol a function provided in the kernel 131 or the middleware 132, caninclude, for example, at least one interface or function (e.g., aninstruction) for file control, window control, image processing,character control or the like.

According to various embodiments, the application 134 can include aShort Message Service (SMS)/Multimedia Message Service (MMS)application, an electronic mail (e-mail) application, a calendarapplication, an alarm application, a health care application (e.g., anapplication measuring momentum, blood sugar or the like), environmentinformation application (e.g., an application providing pressure,humidity, temperature information or the like) or the like. Additionallyor alternatively, the application 134 can be an application related withinformation exchange between the electronic device 101 and an externalelectronic device (e.g., an electronic device 102 or an electronicdevice 104). The application related with the information exchange caninclude, for example, a notification forward application for forwardingspecific information to the external electronic device, or a devicemanagement application for managing the external electronic device.

For example, the notification forward application can include a functionof forwarding to the external electronic device (e.g., the electronicdevice 102 or the electronic device 104) notification informationgenerated in other applications (e.g., the SMS/MMS application, thee-mail application, the health care application, the environmentinformation application or the like) of the electronic device 101.Additionally or alternatively, the notification forward application canreceive the notification information from the external electronic device(e.g., the electronic device 102 or the electronic device 104) andprovide the received notification information to a user, for example.The device management application can manage (e.g., install, delete orupdate) a function (e.g., turn-on/turn-off of the external electronicdevice itself or some constituent parts thereof, or adjustment ofdisplay brightness or resolution) of at least a part of the externalelectronic device (e.g., the electronic device 102 or the electronicdevice 104) communicating with the electronic device 101, an applicationoperating in the external electronic device, or a service (e.g., a callservice or a message service) provided in the external electronicdevice, for example.

According to various embodiments, the application 134 can include anapplication designated according to an attribute (e.g., kind) of theexternal electronic device (e.g., the electronic device 102 or theelectronic device 104). For example, when the external electronic deviceis an MP3 player, the application 134 can include an application relatedwith music playing. Similarly, when the external electronic device is amobile medical instrument, the application 134 can include anapplication related with health care. According to one embodiment, theapplication 134 can include at least one of an application designated tothe electronic device 101 and an application received from the externalelectronic device (e.g., the server 106, the electronic device 102, orthe electronic device 104).

The input/output interface 140 can forward an instruction or data, whichis inputted from a user through a sensor (e.g., an acceleration sensorand a gyro sensor) or an input device (e.g., a keyboard or a touchscreen), for example, to the processor 120, the memory 130, thecommunication interface 160, or the image processing module 170 throughthe bus 110. For example, the input/output interface 140 can provide theprocessor 120 with data about a user's touch inputted through the touchscreen. Also, the input/output interface 140 can output through anoutput device (e.g., a speaker or a display) an instruction or datareceived from the processor 120, the memory 130, the communicationinterface 160, or the image processing module 170 through the bus 110,for example. For example, the input/output interface 140 can outputvoice data, which is processed through the processor 120, to a userthrough the speaker.

The display 150 can display various information (e.g., multimedia data,text data, or the like) to a user.

The communication interface 160 can connect communication between theelectronic device 101 and the external device (e.g., the electronicdevice 102, the electronic device 104, or the server 106). For example,the communication interface 160 can support network communication 162(e.g., the Internet, a Local Area Network (LAN), a Wide Area Network(WAN), a telecommunication network, a cellular network, a satellitenetwork, a Plain Old Telephone System (POTS) or the like), short-rangecommunication 164 (e.g., Wireless Fidelity (WiFi), Bluetooth (BT), orNear Field Communication (NFC)), and wired communication (e.g., aUniverse Serial Bus (USB), a High Definition Multimedia Interface(HDMI), a Recommended Standard-232 (RS-232), a POTS or the like).According to one embodiment, a protocol (e.g., short-range communicationprotocol, network communication protocol, or wired communicationprotocol) for communication between the electronic device 100 and theexternal device can be supported in at least one of the API 133 and themiddleware 132. The electronic devices 102 and 104 each can be the samedevice (e.g., same-type device) as the electronic device 101 or be adifferent device (e.g., different-type device).

The image sensor module 180 can provide image data acquired throughsubject taking, to the image processing module 170. At this time, theimage sensor module 180 can include at least one image sensor modulefunctionally connected to the electronic device 101.

The image processing module 170 can perform image processing for imagedata provided from the image sensor module 180 or the externalelectronic devices 102 and 104. For example, the image processing module170 can perform one or more image processing among level adjustment forimage data, noise removal, gamma correction, and conversion into aformat displayable on the display 150. The image processing module 170can control to store image-processed image data in the memory 130 ordisplay the image data on the display 150. For instance, the imageprocessing module 170 can transmit the image data (e.g., YUV data)displayed on the display 150 and metadata about the corresponding imagedata, to the memory 130. Here, the image processing converting into theformat displayable on the display 150 can include color spaceconversion.

The image processing module 170 can select and synthesize at least twoimage data among image data acquired through at least one image sensormodule 180. For instance, the image processing module 170 can select andsynthesize at least two image data using image acquisition time stampscorresponding to the image data or an image processing delay time andthe image acquisition time stamps.

For another example, when a capture event occurs, the image processingmodule 170 can generate thumbnail data about capture image data usingimage data (e.g., a preview image) stored in the memory 130 and metadataabout each image data. For instance, the image processing module 170 cangenerate thumbnail data about capture image data using a differentmodule logically or physically separated from a module performing imageprocessing for image data provided from the image sensor module 180. Thethumbnail data can represent image data reducing an image to facilitatesearch of the corresponding image or such that a user can easilyrecognize the corresponding image.

FIG. 1B is a block diagram illustrating an electronic device accordingto an embodiment of the present disclosure.

Referring to FIG. 1B, the electronic device 101 can include a processor120, a memory 130, image sensors 180-1 to 180-N, an input unit (inputinterface) 140, and a display unit (i.e., a display) 150. Here, theprocessor 120 can include an Application Processor (AP).

The processor 120 can control the electronic device 100 to providevarious services.

The processor 120 can decipher an instruction received from one or moreother constituent elements (e.g., the memory 130, the image sensors180-1 to 180-N, the display unit 150 and the input unit 140) included inthe electronic device 101, and execute operation or data processingaccording to the deciphered instruction. For example, the processor 120can perform one or more image processing among level adjustment forimage data provided from the image sensors 180-1 to 180-N, noiseremoval, gamma correction, and conversion into a format displayable onthe display unit 150. The processor 120 can control to storeimage-processed image data in the memory 130 or display the image dataon the display unit 150. For instance, the processor 120 can transmitthe image data (e.g., YUV data) displayed on the display unit 150 andmetadata about the corresponding image data, to the memory 130. Here,the image processing converting into the format displayable on thedisplay unit 150 can include color space conversion.

The processor 120 can execute one or more programs stored in the memory130 and control the electronic device 101 to provide various multimediaservices. For example, the processor 120 can execute the program storedin the memory 130 and select and synthesize at least two image dataamong image data acquired through the image sensors 180-1 to 180-N. Forinstance, the processor 120 can select and synthesize at least two imagedata using image acquisition time stamps corresponding to the image dataor an image processing delay time and the image acquisition time stamps.

For another example, when a capture event occurs, the processor 120 cangenerate thumbnail data about capture image data using image-processedimage data (e.g., a preview image) stored in the memory 130 and metadataabout each image data. For instance, the processor 120 can generatethumbnail data about capture image data using a different modulelogically or physically separated from a module (e.g., ISP) performingimage processing for image data provided from the image sensors 180-1 to180-N.

The memory 130 can store an instruction or data which is received fromone or more constituent elements included in the electronic device 101or is generated by the one or more constituent elements. For example,the memory 130 can include an internal memory or an external memory. Theinternal memory can include at least one of, for example, a volatilememory (e.g., a Dynamic Random Access Memory (DRAM), a Static RandomAccess Memory (SRAM), a Synchronous Dynamic Random-Access Memory (SDRAM)and the like) and a nonvolatile memory (e.g., One-Time Programmable ReadOnly Memory (OTPROM), a Programmable Read-Only Memory (PROM), anErasable PROM (EPROM), an Electrically Erasable Programmable ROM(EEPROM), a mask ROM, a flash ROM, a Not AND (NAND) flash memory, a NotOR (NOR) flash memory and the like). The external memory can include aflash drive, for example, at least one of Compact Flash (CF), SecureDigital (SD), micro-SD, xD and a memory stick. The external memory canbe functionally connected with the electronic device 101 through variousinterfaces.

The image sensors 180-1 to 180-N can provide image data acquired throughsubject taking, to the processor 120. At this time, the image sensors180-1 to 180-N can transmit the image data to the processor 120 througha serial interface such as Mobile Industry Processor Interface (MIPI)and Mobile Display Digital Interface (MDDI) and a parallel interfacesuch as a parallel bus. Here, the first image sensor 180-1 can belocated in front of the electronic device 101, and the Nth image sensor180-N can be located in rear of the electronic device 101.

The input unit 140 can transmit an instruction or data inputted by auser, to the processor 120 or the memory 130. For example, the inputunit 140 can include a touch input unit, a pen sensor, a key or anultrasonic wave input device.

The display unit 150 can provide status information of the electronicdevice 101, a still picture, a moving picture or data through agraphical user interface. For example, the display unit 150 can displayone or more images provided from the processor 120. For another example,the display unit 150 can display at least one image selected based on animage acquisition time stamp or the image acquisition time stamp and animage processing delay time in the processor 120.

Though not illustrated, the electronic device 101 can further include acommunication unit capable of connecting communication with otherelectronic devices or servers through voice communication or datacommunication. Here, the communication unit can be divided into aplurality of communication sub modules supporting differentcommunication networks.

In the aforementioned embodiment, the electronic device 101 can includea plurality of image sensors 180-1 to 180-N. At this time, among theplurality of image sensors 180-1 to 180-N, one or more image sensors canbe selectively connected to the electronic device 101. For example,among the plurality of image sensors 180-1 to 180-N, the one or moreimage sensors can be selectively connected to the electronic device 101through a wired interface. For another example, among the plurality ofimage sensors 180-1 to 180-N, the one or more image sensors can beselectively connected with the electronic device 101 through a wirelessinterface such as Bluetooth and a wireless LAN.

FIG. 2 is a detailed block diagram illustrating a processor according toan embodiment of the present disclosure.

Referring to FIG. 2, the processor 120 can include an image processingunit (i.e., Image Signal Processor (ISP)) 200, a display control unit210, an image generation control unit 220, a thumbnail generation unit230, and a moving-picture generation unit 240.

The image processing unit 200 can perform one or more image processingamong level adjustment for image data provided from respective imagesensors 180-1 to 180-N, noise removal, gamma correction, and color spaceconversion. The image processing unit 200 can transmit theimage-processed image data to one or more of the memory 130 and thedisplay control unit 210. For example, the image processing unit 200 cantransmit image data (e.g., YUV data) displayed on the display unit 150and metadata about the corresponding image data, to the memory 130.

The display control unit 210 can control to provide a graphical userinterface through the display unit 150. For example, the display controlunit 210 can control to display image data (e.g., a preview image)provided from the image processing unit 200 or the memory 130, on thedisplay unit 150. For instance, the display control unit 210 can controlto display image data provided from the image sensors 180-1 to 180-Nthrough the image processing unit 200, on the display unit 150 together.

The image generation control unit 220 can select and synthesize at leasttwo image data among image data acquired through the image sensors 180-1to 180-N. For example, when a capture event occurs, the image generationcontrol unit 220 can select and synthesize at least two image data usingan image acquisition time stamp of image data stored in the memory 130or an image processing delay time and the image acquisition time stamp.

The thumbnail generation unit 230 can generate thumbnail data usingimage-processed image data (e.g., a preview image) stored in the memory130 or metadata about the respective image data. For example, when acapture event occurs, the thumbnail generation unit 230 can generatethumbnail data using YUV data of image data stored in the memory 130 andmetadata about the corresponding image data. For instance, in a case ofsynthesizing at least two image data acquired through the plurality ofimage sensors 180-1 to 180-N and generating capture image data, thethumbnail generation unit 230 can synchronize the image data based on aprocessing delay time of each image data and generate thumbnail data. Atthis time, the thumbnail generation unit 230 can interlock the captureimage data and the thumbnail data using an image acquisition time stampor frame identification information included in the metadata and storethe interlock result in the memory 130.

The moving-picture generation unit 240 can encode image-processed imagedata stored in the memory 130 and generate moving-picture data. Forexample, the moving-picture generation unit 240 can include a videopre-processor and a video encoder. The video pre-processor can performpre-processing such as zoom, rotation, color space conversion and flipfor the image-processed image data stored in the memory 130 and storethe pre-processing result in the memory 130. The video encoder encodesthe image data pre-processed by the video pre-processor and stored inthe memory 130 according to a preset encoding method, and generate themoving-picture data.

Though not illustrated, the processor 120 can further include a timesetting unit capable of setting an image acquisition time stamp to oneor more image data provided from the image sensors 180-1 to 180-N. Forexample, the time setting unit can record a time corresponding to eachimage data provided from the image sensors 180-1 to 180-N, in metadataof the corresponding image data every frame unit. For another example,when there are one or more image sensors selectively connectable to theelectronic device 100 among the image sensors 180-1 to 180-N, the timesetting unit can set an image acquisition time stamp to metadata of oneor more image data provided from one or more image sensors connected tothe electronic device 101. At this time, image acquisition time stampscan be set to images acquired through one or more image sensors capableof being selectively connected to the electronic device 101 by aseparate module included in each image sensor.

In the aforementioned embodiment, the processor 120 can process imagedata provided from the image sensors 180-1 to 180-N through one imageprocessing unit 200.

In another embodiment, the processor 120 can include a plurality ofimage processing units and process image data provided from therespective image sensors 180-1 to 180-N.

FIG. 3 is a block diagram illustrating an electronic device according toanother embodiment of the present disclosure.

Referring to FIG. 3, the electronic device 300 can include a processor310, a memory 320, image sensors 330-1 to 330-N, external imageprocessing units 340-1 to 340-(N−1), an input unit 350, and a displayunit 360. Here, the processor 310 can include an AP.

The processor 310 can control the electronic device 300 to providevarious services.

The processor 310 can decipher an instruction received from one or moreother constituent elements (e.g., the memory 320, the first image sensor330-1, the external image processing units 340-1 to 340-(N−1), the inputunit 350, and the display unit 360) included in the electronic device300, and execute operation or data processing according to thedeciphered instruction. For example, the processor 310 can perform oneor more image processing among level adjustment for image data providedfrom the first image sensor 330-1, noise removal, gamma correction, andconversion into a format displayable on the display unit 360. Theprocessor 310 can control to store image-processed image data in thememory 320 or display the image data on the display unit 360. Forinstance, the processor 310 can transmit the image data (e.g., YUV data)displayed on the display unit 360 and metadata about the correspondingimage data, to the memory 320. For another instance, the processor 310can control to convert images stored in the memory 320 into the formatdisplayable on the display unit 360 through the external imageprocessing units 340-1 to 340-(N−1) and display the converted images onthe display unit 360. Here, the image processing converting into theformat displayable on the display unit 360 can include color spaceconversion.

The processor 310 can execute one or more programs stored in the memory320 and control the electronic device 300 to provide various multimediaservices. For example, the processor 310 can execute the program storedin the memory 320 and select and synthesize at least two image dataamong image data acquired through the image sensors 330-1 to 330-N. Forinstance, the processor 310 can select and synthesize at least two imagedata using image acquisition time stamps corresponding to the image dataor an image processing delay time and the image acquisition time stamps.

For another example, when a capture event occurs, the processor 310 cangenerate thumbnail data about capture image data using image-processedimage data (e.g., a preview image) stored in the memory 320 and metadataabout each image data. For instance, the processor 310 can generatethumbnail data about capture image data using a different modulelogically or physically separated from an internal module (e.g., ISP) ofthe processor 310 performing image processing for image data providedfrom the first image sensor 330-1. At this time, the different modulecan be logically or physically distinguished from the internal moduleprocessing an image within the processor 310, or be distinguishedphysically from the processor 310.

The memory 320 can store an instruction or data received from one ormore constituent elements included in the electronic device 300 orgenerated by the one or more constituent elements.

The image sensors 330-1 to 330-N can provide a collected image acquiredthrough subject taking, to the processor 310. At this time, the imagesensors 330-1 to 330-N can transmit the image to the processor 310 orthe external image processing units 340-1 to 340-(N−1) through a serialinterface such as MIPI and MDDI and a parallel interface such as aparallel bus. Here, the first image sensor 330-1 can be located in frontof the electronic device 300, and the Nth image sensor 330-N can belocated in rear of the electronic device 300.

The external image processing units 340-1 to 340-(N−1) can control toperform image processing such as level adjustment for images providedfrom the image sensors 330-2 to 330-N, noise removal, and gammacorrection and store the processing result in the memory 320 through theprocessor 310. Here, the external image processing units 340-1 to340-(N−1) can further include a time setting unit capable of setting animage acquisition time stamp to image data about the images providedfrom the image sensors 330-2 to 330-N. For example, the time settingunit can record a time corresponding to each image data provided fromthe image sensors 330-2 to 330-N, in metadata of corresponding imagedata every frame unit.

The input unit 350 can transmit an instruction or data inputted by auser, to the processor 310 or the memory 320. For example, the inputunit 350 can include a touch input unit, a pen sensor, a key or anultrasonic wave input device.

The display unit 360 can provide status information of the electronicdevice 300, a still picture, a moving picture or data through agraphical user interface. For example, the display unit 360 can displayone or more image data provided from the processor 310. For anotherexample, the display unit 360 can display at least one image dataselected based on an image acquisition time stamp or the imageacquisition time stamp and an image processing delay time in theprocessor 310.

Though not illustrated, the electronic device 300 can further include acommunication unit capable of connecting communication with otherelectronic devices or servers through voice communication or datacommunication. Here, the communication unit can be divided into aplurality of communication sub modules supporting differentcommunication networks.

In the aforementioned embodiment, the electronic device 300 can includea plurality of image sensors 330-1 to 330-N. At this time, among theplurality of image sensors 330-1 to 330-N, one or more image sensors canbe selectively connected to the electronic device 300. For example,among the plurality of image sensors 330-1 to 330-N, the one or moreimage sensors can be selectively connected to the electronic device 300through a wired interface. In this case, the external image processingunit connected to the one or more image sensors selectively connectableto the electronic device 300 can be mounted in the electronic device300, or be selectively connected to the electronic device 300 togetherwith the image sensor.

For another example, among the plurality of image sensors 330-1 to330-N, the one or more image sensors can be selectively connected withthe electronic device 300 through a wireless interface such as Bluetoothand a wireless LAN. In this case, the external image processing unitconnected to the one or more image sensors selectively connectable tothe electronic device 300 can be connected to the electronic device 300,or be selectively connected to the electronic device 300 together withthe image sensor.

FIG. 4 is a detailed block diagram illustrating a processor according toanother embodiment of the present disclosure.

Referring to FIG. 4, the processor 310 can include an image processingunit (i.e., ISP) 400, an internal interface 410, a format change unit420, a display control unit 430, an image generation control unit 440, athumbnail generation unit 450, and a moving-picture generation unit 460.

The image processing unit 400 can perform one or more image processingamong level adjustment for image data provided from a first image sensor330-1, noise removal, gamma correction, and color space conversion. Theimage processing unit 400 can transmit the image-processed image data toone or more of the memory 320 and the display control unit 430. Forexample, the image processing unit 400 can transmit image data (e.g.,YUV data) displayed on the display unit 360 and metadata about thecorresponding image data, to the memory 320.

The internal interface 410 can transmit to the memory 320 image dataprovided from respective external image processing units 340-1 to340-(N−1). For example, the internal interface 410 can include one ormore of MIFI and CAMIF.

The format change unit 420 can change image data provided from theexternal image processing units 340-1 to 340-(N−1) stored in the memory320, into a format of image data displayable on the display unit 360.For example, the format change unit 420 can color-space convert theimage data provided from the memory 320 and transmit the image data tothe display control unit 430. For instance, the format change unit 420can control to store in the memory 320 the image data provided from theexternal image processing units 340-1 to 340-(N−1) changed into theformat of the image data displayable on the display unit 360.

The display control unit 430 can control to provide a graphical userinterface through the display unit 360. For example, the display controlunit 430 can control to display on the display unit 360 images providedfrom one or more of the image processing unit 400 and the format changeunit 420. For instance, the display control unit 430 can control todisplay image data provided from the first image sensor 330-1 providedthrough the image processing unit 400 and image data of the Nth imagesensor 330-N provided through the format change unit 420, on the displayunit 360 together.

The image generation control unit 440 can select and synthesize at leasttwo image data among image data acquired through the image sensors 330-1to 330-N. For example, when a capture event occurs, the image generationcontrol unit 440 can select and synthesize at least two image data usingan image acquisition time stamp of images stored in the memory 320 or animage processing delay time and the image acquisition time stamp.

The thumbnail generation unit 450 can generate thumbnail data usingimage-processed image data stored in the memory 320 or metadata aboutthe respective image data. For example, when a capture event occurs, thethumbnail generation unit 450 can generate thumbnail data using YUV dataof each image data stored in the memory 320 and metadata about thecorresponding image data. For instance, in a case of synthesizing atleast two image data acquired through the plurality of image sensors330-1 to 330-N and generating capture image data, the thumbnailgeneration unit 450 can synchronize the image data based on a processingdelay time of each image data and generate thumbnail data. At this time,the thumbnail generation unit 450 can interlock the capture image dataand the thumbnail data using an image acquisition time stamp or frameidentification information included in the metadata and store theinterlock result in the memory 320.

The moving-picture generation unit 460 can encode image-processed imagedata stored in the memory 320 and generate moving-picture data. Forexample, the moving-picture generation unit 460 can include a videopre-processor and a video encoder. The video pre-processor can performpre-processing such as zoom, rotation, color space conversion and flipfor the image-processed image data stored in the memory 320 and storethe pre-processing result in the memory 320. The video encoder encodesthe image data pre-processed by the video pre-processor and stored inthe memory 320 according to a preset encoding method, and generate themoving-picture data.

Though not illustrated, the processor 310 can further include a timesetting unit capable of setting an image acquisition time stamp to imagedata provided from the first image sensor 330-1 or the first imagesensor 330-1 and the external image processing units 340-1 to 340-(N−1).For example, the time setting unit can record a time corresponding toimage data provided from the first image sensor 330-1, in metadata ofthe corresponding image data every frame unit. At this time, imageacquisition time stamps can be set to the image data acquired throughthe second image sensor 330-2 to the Nth image sensor 330-N by theexternal image processing unit connected to each image sensor.

In the aforementioned embodiment, the processor 310 can include theformat change unit 420 for changing the image data provided from theexternal image processing units 340-1 to 340-(N−1) into the format ofimage data displayable on the display unit 360.

In another embodiment, if the external image processing units 340-1 to340-(N−1) can change the image data into the format of image datadisplayable on the display unit 360, the processor 310 can beconstructed to exclude the format change unit 420.

FIG. 5 is a block diagram illustrating an electronic device according toa further embodiment of the present disclosure.

Referring to FIG. 5, the electronic device 500 can include a processor510, memories 520 and 550, image sensors 530-1 to 530-N, external imageprocessing units 540-1 to 540-(N−1), a display unit 560, and an inputunit 570. Here, the processor 510 can include an AP.

The processor 510 can control the electronic device 500 to providevarious services.

The processor 510 can decipher an instruction received from one or moreother constituent elements included in the electronic device 500, andexecute operation or data processing according to the decipheredinstruction. For example, the processor 510 can perform one or moreimage processing among level adjustment for image data provided from thefirst image sensor 530-1, noise removal, gamma correction, andconversion into a format displayable on the display unit 560. Theprocessor 510 can control to store image-processed image data in thefirst memory 520 or display the image data on the display unit 560. Forinstance, the processor 510 can transmit the image data (e.g., YUV data)displayed on the display unit 560 and metadata about the correspondingimage data, to the first memory 520. Here, the image processingconverting into the format displayable on the display unit 560 caninclude color space conversion.

The processor 510 can execute one or more programs stored in the firstmemory 520 and control the electronic device 500 to provide variousmultimedia services. For example, the processor 510 can execute theprogram stored in the memory 520 and select and synthesize at least twoimage data among image data acquired through the image sensors 530-1 to530-N. For instance, the processor 510 can select and synthesize atleast two image data using image acquisition time stamps correspondingto the image data or an image processing delay time and the imageacquisition time stamps.

For another example, when a capture event occurs, the processor 510 cangenerate thumbnail data about capture image data using image-processedimage data (e.g., a preview image) stored in the first memory 520 andmetadata about each image data. For instance, the processor 510 cangenerate thumbnail data about capture image data using a differentmodule separate from a module (e.g., ISP) performing image processingfor image data provided from the first image sensor 530-1.

The first memory 520 can store an instruction or data received from oneor more constituent elements included in the electronic device 500 orgenerated by the one or more constituent elements.

The image sensors 530-1 to 530-N can provide an image acquired throughsubject taking, to the processor 510. At this time, the image sensors530-1 to 530-N can transmit the image to the processor 510 or theexternal image processing units 540-1 to 540-(N−1) through a serialinterface such as MIPI and MDDI and a parallel interface such as aparallel bus. Here, the first image sensor 530-1 can be located in frontof the electronic device 500, and the N_(th) image sensor 530-N can belocated in rear of the electronic device 500.

The external image processing units 540-1 to 540-(N−1) can control toperform image processing such as level adjustment for image dataprovided from the image sensors 530-2 to 530-N, noise removal, gammacorrection, and color space conversion and store the processing resultin the first memory 520. Also, the external image processing units 540-1to 540-(N−1) can control to set time information to the image dataprovided from the image sensors 530-2 to 530-N and store the image datasetting the time information in the second memory 550. For instance, theexternal image processing units 540-1 to 540-(N−1) can set timeinformation to metadata of corresponding image data.

The second memory 550 can store non-processed image data provided fromthe external image processing units 540-1 to 540-(N−1). For example, thesecond memory 550 can store raw image data provided from the externalimage processing units 540-1 to 540-(N−1). At this time, the secondmemory 550 can exist by each of the external image processing unit 540-1or 540-(N−1).

The display unit 560 can provide status information of the electronicdevice 500, a still picture, a moving picture or data through agraphical user interface. For example, the display unit 560 can displayone or more image data provided from the processor 510. For anotherexample, the display unit 560 can display at least two image dataselected based on an image acquisition time stamp or the imageacquisition time stamp and an image processing delay time in theprocessor 510.

The input unit 570 can transmit an instruction or data inputted by auser, to the processor 510 or the first memory 520. For example, theinput unit 570 can include a touch input unit, a pen sensor, a key or anultrasonic wave input device.

Though not illustrated, the electronic device 500 can further include acommunication unit capable of connecting communication with otherelectronic devices or servers through voice communication or datacommunication. Here, the communication unit can be divided into aplurality of communication sub modules supporting differentcommunication networks.

In the aforementioned embodiment, the electronic device 500 can includea plurality of image sensors 530-1 to 530-N. At this time, among theplurality of image sensors 530-1 to 530-N, one or more image sensors canbe selectively connected to the electronic device 500. For example,among the plurality of image sensors 530-1 to 530-N, the one or moreimage sensors can be selectively connected to the electronic device 500through a wired interface. In this case, the external image processingunit connected to the one or more image sensors selectively connectableto the electronic device 500 can be mounted in the electronic device500, or be selectively connected to the electronic device 500 togetherwith the image sensor.

For another example, among the plurality of image sensors 530-1 to530-N, the one or more image sensors can be selectively connected withthe electronic device 500 through a wireless interface such as Bluetoothand a wireless LAN. In this case, the external image processing unitconnected to the one or more image sensors selectively connectable tothe electronic device 500 can be connected to the electronic device 500,or be selectively connected to the electronic device 500 together withthe image sensor.

FIG. 6 is a detailed block diagram illustrating a processor according toa further embodiment of the present disclosure.

Referring to FIG. 6, the processor 510 can include an image processingunit (i.e., ISP) 600, an internal interface 610, a display control unit620, an image generation control unit 630, a moving-picture generationunit 640, and a thumbnail generation unit 650.

The image processing unit 600 can perform one or more image processingamong level adjustment for image data provided from a first image sensor530-1, noise removal, gamma correction, and color space conversion. Theimage processing unit 600 can transmit the image-processed image data toone or more of the first memory 520 and the display control unit 620.For example, the image processing unit 600 can transmit image data(e.g., YUV data) displayed on the display unit 560 and metadata aboutthe corresponding image data, to the first memory 520.

The internal interface 610 can transmit to the first memory 520 imagesprovided from respective external image processing units 540-1 to540-(N−1). For example, the internal interface 610 can include one ormore of MIFI and CAMIF, and RDI for transmitting an image converted intoa format displayable on the display unit 560 in the external imageprocessing unit 540-1 or 540-(N−1).

The display control unit 620 can control to provide a graphical userinterface through the display unit 560. For example, the display controlunit 620 can control to display on the display unit 560 image dataprovided from one or more of the image processing unit 600 and the firstmemory 520. For instance, the display control unit 620 can control todisplay image data of the first image sensor 530-1 provided through theimage processing unit 600 and image data of the Nth image sensor 530-Nacquired from the first memory 520, on the display unit 560 together.

The image generation control unit 630 can select and synthesize at leasttwo image data among image data acquired through the image sensors 530-1to 530-N. For example, when a capture event occurs, the image generationcontrol unit 630 can select and synthesize at least two image data usingan image acquisition time stamp of image data stored in the first memory520 and the second memory 550 or an image processing delay time and theimage acquisition time stamp.

The moving-picture generation unit 640 can encode image-processed imagedata stored in the first memory 520 and the second memory 550 andgenerate moving-picture data. For example, the moving-picture generationunit 640 can include a video pre-processor and a video encoder. Thevideo pre-processor can perform pre-processing such as zoom, rotation,color space conversion and flip for the image data stored in the firstmemory 520 and the second memory 550 and store the pre-processing resultin one or more of the first memory 520 and the second memory 550. Thevideo encoder can encode the image data pre-processed by the videopre-processor and stored in one or more of the first memory 520 and thesecond memory 550 according to a preset encoding method, and generatethe moving-picture data.

The thumbnail generation unit 650 can generate thumbnail data usingimage-processed image data (e.g., a preview image) stored in the firstmemory 520 or metadata about the respective image data. For example,when a capture event occurs, the thumbnail generation unit 650 cangenerate thumbnail data using YUV data of each image data stored in thefirst memory 520 and metadata about the corresponding image data. Forinstance, in a case of synthesizing at least two image data acquiredthrough the plurality of image sensors 530-1 to 530-N and generatingcapture image data, the thumbnail generation unit 650 can synchronizethe image data based on a processing delay time of each image data andgenerate thumbnail data. At this time, the thumbnail generation unit 650can interlock the capture image data and the thumbnail data using animage acquisition time stamp or frame identification informationincluded in the metadata and store the interlock result in the firstmemory 520.

Though not illustrated, the processor 510 can further include a timesetting unit capable of setting an image acquisition time stamp to imagedata provided from the first image sensor 530-1 or the first imagesensor 530-1 and the external image processing units 540-1 to 540-(N−1).For example, the time setting unit can record a time corresponding toimage data provided from the first image sensor 530-1, in metadata ofthe corresponding image data every frame unit. At this time, imageacquisition time stamps can be set to images acquired through the secondimage sensor 530-2 to the Nth image sensor 530-N by the external imageprocessing unit connected to each image sensor. For another example, thetime setting unit can record a time corresponding to image data providedfrom the external image processing unit 540-(N−1), in metadata of thecorresponding image data every frame unit. In this case, the imagegeneration control unit 630 can select and synthesize at least twoimages for synthesizing based on an image acquisition time stamp ofimages stored in the first memory 520.

FIG. 7 is a detailed block diagram illustrating an external imageprocessing unit according to an embodiment of the present disclosure.

Referring to FIG. 7, the external image processing unit 540 can includean image processing control unit 700 and a time setting unit 710.

The image processing control unit 700 can perform one or more imageprocessing among level adjustment for image data provided from the imagesensor 530-2 or 530-N, noise removal, gamma correction, and conversioninto a format displayable on the display unit 560. For example, theimage processing control unit 700 can color-space convert image data ofYUV422 provided from the image sensor 530-2 to 530-N into image data ofYUV 420 so as to convert into a format displayable on the display unit560.

The image processing control unit 700 can convert one or more image datastored in the second memory 550 into a format displayable on the displayunit 560 and transmit the converted image data to the image generationcontrol unit 630. For example, the image processing control unit 700 canreceive image data selected for image synthesis from the second memory550 according to control of the image generation control unit 630 ofFIG. 6, convert the received image data into the format displayable onthe display unit 560, and transmit the converted image data to the imagegeneration control unit 630. For another example, when a capture eventoccurs, the image processing control unit 700 can convert one or moreimage data among images stored in the second memory 550 into the formatdisplayable on the display unit 560 and transmit the converted imagedata to the image generation control unit 630.

The time setting unit 710 can set an image acquisition time stamp toimage data provided from the image sensor 530-2 or 530-N. For example,the time setting unit can include a time insertion unit and a framesetting unit and record a time corresponding to the image data providedfrom the image sensor 530-2 or 530-N every frame unit.

In the aforementioned embodiment, the external image processing unit 540can include the image processing control unit 700 and the time settingunit 710. In another embodiment, the time setting unit 710 can belocated outside the external image processing unit 540.

FIG. 8 is a detailed block diagram illustrating a memory according to anembodiment of the present disclosure.

Referring to FIG. 8, the first memory 520 can be logically or physicallydivided into a plurality of blocks 800, 810, and 820 to store data. Forexample, image data provided from the image processing unit 600 of theprocessor 510 can be stored in the third block 820 of the first memory520.

The image data provided from the external image processing units 540-1to 540-(N−1) can be stored in the first block 800 of the first memory520. At this time, the image data can be divided into Y data, UV data,and metadata and be stored in internal blocks 802, 804, and 806 in thefirst block 800. Here, the metadata can include one or more of a frameidentifier of image data, an image acquisition time stamp, focusinformation, and image setting information (EXIF).

When a capture event occurs, image data stored in the second memory 550can be stored in the third block 820 of the first memory 520 through theexternal image processing unit 540-1 to 540-(N−1).

In the aforementioned embodiment, the electronic device can transmitimage data generated through an image sensor, to each module using aserial interface and a parallel interface. For example, an electronicdevice can transmit the image data generated through the image sensor,to each module using a MIPI interface constructed as in FIG. 9 below.

FIG. 9 is a block diagram illustrating an interface according to anembodiment of the present disclosure.

Referring to FIG. 9, a MIPI interface can include a plurality of lanes900 according to a format of data. For example, the MIPI interface canbe composed of a MIPI 4-Lane PHY, a MIPI 2-Lane PHY, and a MIPI 1-LanePHY according to a transmission data capacity.

The MIPI interface can transmit image data to a corresponding module 930through a serial interface (e.g., a Camera Serial Interface (CSI)) 910corresponding to each lane 900. For example, the MIPI 4-Lane PHY cantransmit the image data to one or more modules through MIPI CSI_0, andthe MIPI 2-Lane PHY can transmit the image data to one or more modulesthrough a MIPI CSI_1, and the MIPI 1-Lane PHY can transmit the imagedata to one or more modules through a MIPI CSI_2.

The module receiving image data through the MIPI interface can process aformat of the image data according to a characteristic of each module.For example, a VPE module can perform image processing such as zoom,rotation, color space conversion and flip for the image data providedthrough the MIPI interface. A Joint Photographic Experts Group (JPEG)Decoding (DCD) module can support a hardware acceleration functionnecessary for decoding image data of a JPEG format provided through theMIPI interface. A VFE module can apply various effects such as colorchange to the image data provided through the MIPI interface. An offlineJEPG module can support a hardware acceleration function necessary forencoding the image data of the JPEG format provided through the MIPIinterface.

When transmitting the image data through the MIPI interface constructedas above, an electronic device can use a division transmission method ofdividing and transmitting image data due to the limitation of a memoryand a transmission capacity of the MIPI interface. For example, whentransmitting image data of 11 Mega Bytes (MB), the electronic device candivide the image data of 11 MB into 8 MB data 1200 and 3 MB data 1210and transmit the divided image data through the MIPI interface. Forinstance, the electronic device can divide image data of 11 MB into 8 MBdata 1200 and 3 MB data 1210 and store the divided image data as in FIG.12A, and transmit the divided image data 1200 and 1210 through a PIPEmethod. The memory of the electronic device receiving the data 1200 and1210 divided through the MIPI interface can collect the divided data1200 and 1210 as one data and store the divided data 1200 and 1210 in adivided format. As in FIG. 12B, the electronic device can flexibly setthe size (e.g., the size of divided data) of the memory and the numberof division of data. For another example, if the electronic device cantransmit data of 11 MB at one time through the MIPI interface, as inFIG. 12B, the electronic device can use a preset data capacity (e.g., 3MB) among the 11 MB for a preview image, and transmit raw image datausing the remnant data capacity (e.g., 8 MB). In this case, theelectronic device can transmit the raw image data at one time or divideand transmit the raw image data through the MIPI interface based on thesize of the raw image data. For instance, if raw image data is 7 MB, theelectronic device can transmit 3 MB for a preview image and 7 MB for theraw image data at one time through the MIPI interface. If raw image datais 15 MB, the electronic device can fixedly use 3 MB for a previewimage, and divide the raw image data into 8 MB and 7 MB raw image dataand transmit the 8 MB and 7 MB raw image data at one time through theMIPI interface over twice. When dividing and transmitting the raw imagedata, the electronic device can combine the divided raw image data intoone image using metadata.

According to an embodiment of the present disclosure, an electronicdevice includes a first image sensor, a second image sensor, one or moreimage processing modules, a display, and a thumbnail generation unit.The first image sensor generates first image data. The second imagesensor generates second image data. The one or more image processingmodules process one or more image data among the first image and thesecond image data. The display unit displays the one or more image dataamong the first image data and second image data processed by the one ormore image processing modules. The thumbnail generation module generatesthumbnail data using the one or more image data among the first imagedata and second image data processed by the one or more image processingmodules.

The one or more image processing modules comprise a first imageprocessing module configured to process the first image data receivedfrom the first image sensor, a second image processing module configuredto process the second image data received from the second image sensor,wherein the first image processing module is formed in an ApplicationProcessor (AP).

The thumbnail generation module is formed in the application processor.

The one or more image processing modules are configured to process theone or more image data among the first image data and the second imagedata, and generate one or more preview data of a format displayable onthe display and metadata about corresponding image data.

At a capture event, the thumbnail generation module is configured togenerate thumbnail data about capture image data using one or more amongone or more preview data and metadata about corresponding image datagenerated in the one or more image processing modules.

The electronic device may further comprising a memory, wherein thethumbnail generation module is configured to interlock the thumbnaildata and the capture image data using an image acquisition time stampcomprised in the metadata or frame identification information and storethe interlock result in the memory.

FIG. 10 is a flowchart illustrating a procedure for generating thumbnaildata in an electronic device according to an embodiment of the presentdisclosure.

Referring to FIG. 10, in step 1001, the electronic device can generateimage data using a plurality of image sensors. For example, theelectronic device can generate the image data using a first image sensorlocated in front of the electronic device and a second image sensorlocated in rear of the electronic device.

When generating the image data, in step 1003, the electronic device canconvert the image data into a preview format displayable on a displayunit. For instance, the electronic device can convert the image datainto the preview format displayable on the display unit using one ormore image processing units (i.e., ISPs). For example, when referring toFIG. 2, the electronic device 100 can convert image data generatedthrough the image sensors 130-1 to 130-N into a preview format (e.g.,YUV data) displayable on the display unit 140 using the image processingunit 200. At this time, the image processing unit 200 can generatemetadata about the image data converted into the preview formatdisplayable on the display unit 140 together and store the image dataand the metadata about the image data in the memory 120. For anotherexample, when referring to FIG. 5 and FIG. 6, the electronic device 500can convert image data generated through the first image sensor 530-1into the preview format (e.g., YUV data) displayable on the display unit140 using the image processing unit 600, and convert image datagenerated through the second image sensor 530-2 to the Nth image sensor530-N into the preview format displayable on the display unit 140 usingthe external image processing units 540-1 to 540-(N−1). At this time,the image processing unit 600 and the external image processing units540-1 to 540-(N−1) can generate metadata about the image data convertedinto the preview format displayable on the display unit 140 together andstore the image data and the metadata about the image data in one ormore memories among the first memory 520 and the second memory 550.Here, the metadata can include one or more of a frame IDentifier (ID) ofthe corresponding image data, an image acquisition time stamp, and imagesetting information (EXIF).

When converting the image data into the preview format displayable onthe display unit, in step 1005, the electronic device can generatethumbnail data about capture image data using the data of the previewformat. For instance, the electronic device can generate the thumbnaildata using a different module separate from the image processing unit.For example, when referring to FIG. 2, the thumbnail generation unit 230of the electronic device 100 can generate thumbnail data about captureimage data using image data of a preview format and metadata of thecorresponding image data stored in the memory 120. For another example,when referring to FIG. 5 and FIG. 6, the thumbnail generation unit 650of the electronic device 500 can generate thumbnail data about captureimage data using image data of a preview format and metadata of thecorresponding image data stored in one or more memories among the firstmemory 520 and the second memory 550.

FIG. 11 is a flowchart illustrating a procedure for interlocking andstoring thumbnail data and capture image data in an electronic deviceaccording to an embodiment of the present disclosure.

Referring to FIG. 11, in step 1101, the electronic device can generateimage data using a plurality of image sensors. For example, theelectronic device can generate the image data using a first image sensorlocated in front of the electronic device and a second image sensorlocated in rear of the electronic device.

When generating the image data, in step 1103, the electronic device canconvert the image data into a preview format displayable on a displayunit. For instance, the electronic device can convert the image datainto the preview format displayable on the display unit using one ormore image processing units (i.e., ISPs). At this time, the electronicdevice can store in a memory image data converted into a preview formatin one or more image processing units and metadata about thecorresponding image data. Here, the metadata can include one or more ofa frame ID of the corresponding image data, an image acquisition timestamp, and image setting information (EXIF).

When converting the image data into the preview format displayable onthe display unit, in step 1105, the electronic device can display theimage data of the preview format on the display unit.

In step 1107, the electronic device can determine if a capture eventtakes place. For example, the electronic device can determine if aninput of a hardware button corresponding to the capture event is sensed.For another example, the electronic device can determine if a selectionof an icon corresponding to the capture event is sensed. For furtherexample, the electronic device can determine if a user's gesturecorresponding to the capture event is sensed.

If the capture event does not take place in step 1107, the electronicdevice can return to step 1101 and generate image data using theplurality of image sensors.

If the capture event occurs in step 1107, in step 1109, the electronicdevice can generate thumbnail data about capture image data using theimage data of the preview format. For example, when a first image sensorof a low capacity is located in front of the electronic device and asecond image sensor of a high capacity is located in rear thereof, theelectronic device can use low-capacity image data generated through thefirst image sensor, as preview image data displayable on the displayunit. The electronic device can convert high-capacity image datagenerated through the second image sensor into a preview format andgenerate preview image data. According to this, when the capture eventtakes place by a time of a processing delay of the high-capacity imagedata, the electronic device can recognize and synthesize as captureimage data the low-capacity image data corresponding to the previewimage data displayed on the display unit at a capture event occurrencetime point and the high-capacity image data including an imageacquisition time stamp corresponding to the capture event occurrencetime point. At the time of thumbnail data generation according to thecapture event, the electronic device can generate thumbnail data bysynthesizing preview image data of the low-capacity image data displayedon the display unit at the capture event occurrence time point and apreview image for the high-capacity image data including the imageacquisition time stamp corresponding to the capture event occurrencetime stamp. For instance, the electronic device can generate thethumbnail data using a different module separate from the imageprocessing unit.

After generating the thumbnail data, in step 1111, the electronic devicecan interlock the thumbnail data and the capture image data usingmetadata of the thumbnail data and store the interlock result. Forexample, the electronic device can interlock the capture image data andthe thumbnail data using the image acquisition time stamp or frameidentification information included in the metadata used for generatingthe thumbnail data, and store the interlock result in the memory.

According to an embodiment of the present disclosure, an operationmethod of an electronic device is provided. The method includes theoperations of generating a plurality of image data using a plurality ofimage sensors, converting the plurality of image data into a formatdisplayable on a display unit through one or more image processingmodules, and generating thumbnail data using the image data of thedisplayable format converted in the image processing modules, in a othermodule separate from the image processing modules.

The method may further comprise, generating the plurality of image datausing the plurality of image sensors connected to the electronic device,or connected with the electronic device through a wired interface or awireless interface.

The method may further include, displaying on the display one or moreimage data among the image data of the displayable format converted inthe image processing modules.

The converting into the displayable format include, converting firstimage data generated using a first image sensor among the plurality ofimage sensors into the format displayable on the display, using a firstimage processing module formed in an Application Processor (AP), andconverting second image data generated using a second image sensor amongthe plurality of image sensors into the format displayable on thedisplay, using a second image processing module formed separately fromthe AP.

The generating the thumbnail data include, the operation of generatingthe thumbnail data using the image data of the displayable formatconverted in the first image processing module and the second imageprocessing module, in the other module comprised in the AP.

The converting into the displayable format include, processing the oneor more image data among the plurality of image data using the one ormore image processing modules, and generating one or more preview dataof the format displayable on the display and metadata aboutcorresponding image data.

The generating the thumbnail data include, at a capture event,generating thumbnail data about capture image data using one or moreamong the one or more preview data and the metadata about correspondingimage data generated in the one or more image processing modules, in theother module.

The method may further include, interlocking the thumbnail data and thecapture image data using an image acquisition time stamp comprised inthe metadata or frame identification information, and storing theinterlock result in a memory.

According to an embodiment of the present disclosure, an electronicdevice includes one or more image sensors and an interface. The one ormore image sensors generate image data. The interface processes theimage data generated in the one or more image sensors. The interfacetransmits the image data to one or more modules. The one or more moduleschange a format of the image data based on an image data processingmethod of a corresponding module.

The interface comprises an interface of a Mobile Industry ProcessorInterface (MIPI) method.

The one or more modules comprise one or more of an Image SignalProcessor (ISP), a Video Preprocessing (VPE) module, a Video Front-End(VFE) module, and a preview image generation module.

When the format of the image data is changed based on the image dataprocessing methods of the one or more modules, the ISP generatesmetadata comprising information about the format change of the imagedata.

The metadata comprises one or more of frame identification informationof the image data, an image acquisition time stamp, and image settinginformation (Exchangeable Image File Format (EXIF)).

The ISP is configured to generate thumbnail data of the image datagenerated in the one or more image sensors, using the metadata.

The interface is configured to divide the image data into a plurality ofpieces based on a transmission capacity of the interface and transmitthe divided image data to the one ore modules.

FIG. 13 is a block diagram illustrating an electronic device accordingto a further embodiment of the present disclosure. In the followingdescription, the electronic device 1300 can construct the whole or partof the electronic device 101 illustrated in FIG. 1, for example.

Referring to FIG. 13, the electronic device 1300 can include one or moreprocessors 1310, a SIM card 1314, a memory 1320, a communication module1330, a sensor module 1340, an input module 1350, a display module 1360,an interface 1370, an audio module 1380, a camera module 1391, a powermanagement module 1395, a battery 1396, an indicator 1397, or a motor1398.

The processor 1310 (e.g., the processor 120) can include one or more APs1311 or one or more Communication Processors (CPs) 1313. In FIG. 13, itis illustrated that the AP 1311 and the CP 1313 are included within theprocessor 1310, but the AP 1311 and the CP 1313 can be included withindifferent IC packages, respectively. According to one embodiment, the AP1311 and the CP 1313 can be included within one IC package.

The AP 1311 can drive an operating system or application program andcontrol a plurality of hardware or software constituent elementsconnected to the AP 1311, and can perform processing and operations ofvarious data including multimedia data. The AP 1311 can be implemented,for example, as a System on Chip (SoC). According to one embodiment, theprocessor 1310 can further include a Graphics Processing Unit (GPU) (notshown).

The CP 1313 can perform a function of managing a data link andconverting a communication protocol in communication between theelectronic device 1300 (e.g., the electronic device 101) and otherelectronic devices (e.g., the electronic device 102, the electronicdevice 104, or the server 106) connected to a network. The CP 1313 canbe implemented, for example, as an SoC. According to one embodiment, theCP 1313 can perform at least a part of a multimedia control function.The CP 1313 can perform discrimination and authentication of anelectronic device within a communication network using a subscriberidentity module (e.g., the SIM card 1314). Also, the CP 1313 can provideservices of a voice call, a video call, a text message, packet data orthe like to a user.

Also, the CP 1313 can control data transmission/reception of thecommunication module 1330. In FIG. 13, constituent elements such as theCP 1313, the power management module 1395, the memory 1320 or the likeare illustrated as constituent elements separate from the AP 1311 but,according to one embodiment, the AP 1311 can be implemented to includeat least some (e.g., the CP 1313) of the aforementioned constituentelements.

According to one embodiment, the AP 1311 or the CP 1313 can load to avolatile memory an instruction or data received from a nonvolatilememory connected to each or at least one of other constituent elements,and process the loaded instruction or data. Also, the AP 1311 or the CP1313 can store data received from at least one of other constituentelements or generated by at least one of the other constituent elements,in the nonvolatile memory.

The SIM card 1314 can be a card including the subscriber identitymodule, and can be inserted into a slot provided in a specific locationof the electronic device. The SIM card 1314 can include uniqueidentification information (e.g., an Integrated Circuit Card ID (ICCID))or subscriber information (e.g., International Mobile SubscriberIdentity (IMSI)).

The memory 1320 (e.g., the memory 130) can include an internal memory1322 or an external memory 1324. The internal memory 1322 can include atleast one of, for example, a volatile memory (e.g., a DRAM, a SRAM, aSDRAM and the like) and a nonvolatile memory (e.g., OTPROM, a PROM, anEPROM, an EEPROM, a mask ROM, a flash ROM, a NAND flash memory, a NORflash memory and the like). According to one embodiment, the internalmemory 822 can be an SSD. The external memory 1324 can further include aflash drive, for example, CF, SD, micro-SD, Mini-SD, xD, a memory stickor the like. The external memory 1324 can be functionally connected withthe electronic device 1300 through various interfaces. According to oneembodiment, the electronic device 1300 can further include a storagedevice (or storage media) such as a hard disk.

The communication module 1330 (e.g., the communication interface 160)can include a wireless communication module 1331 or a Radio Frequency(RF) module 1334. The wireless communication module 1331 can include,for example, WiFi 1333, BT 1335, GPS 1337 or NFC 1339. For example, thewireless communication module 1331 can provide a wireless communicationfunction using a radio frequency. Additionally or alternatively, thewireless communication module 1331 can include a network interface(e.g., a LAN card), a modem or the like for connecting the electronicdevice 1300 with a network (e.g., the Internet, a LAN, a WAN, atelecommunication network, a cellular network, a satellite network, aPOTS or the like).

The RF module 1334 can take charge of transmission/reception of data,for example, transmission/reception of an RF signal. The RF module 1334can include, though not illustrated, a transceiver, a PluggableAuthentication Module (PAM), a frequency filter, a Low Noise Amplifier(LNA) or the like, for example. Also, the RF module 1334 can furtherinclude components for transmitting/receiving electromagnetic wave on afree space in wireless communication, for example, a conductor, aconductive line or the like.

The sensor module 1340 can measure a physical quantity, sense anactivation state of the electronic device 1300, and convert the measuredor sensed information into an electrical signal. The sensor module 1340can include, for example, at least one of a gesture sensor 1340-A, agyro sensor 1340-B, a pressure sensor 1340-C, a magnetic sensor 1340-D,an accelerator sensor 1340-E, a grip sensor 1340-F, a proximity sensor1340-G, a color sensor 1340-H (e.g., an RGB sensor), a biological sensor1340-I, a temperature/humidity sensor 1340-J, a light sensor 1340-K, anda Ultraviolet (UV) sensor 1340-M. Additionally or alternatively, thesensor module 1340 can include, for example, an odor sensor (not shown),an Electromyography (EMG) sensor (not shown), an Electroencephalography(EEG) sensor (not shown), an Electrocardiograph (ECG) sensor (notshown), an Infrared (IR) sensor (not shown), an iris sensor (not shown),a fingerprint sensor (not shown) or the like. The sensor module 1340 canfurther include a control circuit for controlling at least one or moresensors belonging to therein.

The input module 1350 can include a touch panel 1352, a (digital) pensensor 1354, a key 1356 or an ultrasonic wave input device 1358. Thetouch panel 1352 can recognize a touch input, for example, in at leastone method among a capacitive method, a pressure sensitive method, aninfrared method, and an ultrasonic wave method. Also, the touch panel1352 can further include a control circuit. In the capacitive method,physical contact or proximity recognition is possible. The touch panel1352 can further include a tactile layer. In this case, the touch panel1352 can provide a tactile response to a user.

The (digital) pen sensor 1354 can be implemented, for example, in thesame or similar method as receiving a user's touch input, or using aseparate recognizing sheet. The key 1356 can include, for example, aphysical button, an optical key, a keypad, or a touch key. Theultrasonic wave input device 1358, which is a device capable of sensinga sound wave by a microphone (e.g., microphone 1388) and confirming datain an electronic device, enables wireless recognition through an inputtool generating an ultrasonic wave signal. According to one embodiment,the electronic device 1300 can receive a user input from an externaldevice (e.g., a network, a computer, or a server) connected to thisusing the communication module 1330.

The display module 1360 (e.g., the display 150) can include a panel1362, a hologram 1364, or a projector 1366. The panel 1362 can be, forexample, a Liquid Crystal Display (LCD), an Active-Matrix OrganicLight-Emitting Diode (AMOLED), or the like. The panel 1362 can beimplemented, for example, to be flexible, transparent, or wearable. Thepanel 1362 can be constructed as one module with the touch panel 1352.The hologram 1364 can represent a three-dimensional image in the airusing interference of light. The projector 1366 can project light to ascreen and display a video. The screen can be located, for example,inside or outside the electronic device 100. According to oneembodiment, the display module 1360 can further include a controlcircuit for controlling the panel 1362, the hologram 1364, or theprojector 1366.

The interface 1370 can include, for example, an HDMI 1372, a USB 1374,an optical communication terminal 1376, or a D-subminiature (D-sub)1378. The interface 1370 can include, for example, the communicationinterface 160 illustrated in FIG. 1. Additionally or alternatively, theinterface 1370 can include, for example, Mobile High-definition Link(MHL) (not shown), Secure Digital/Multi Media Card (SD/MMC) (not shown),or Infrared Data Association (IrDA) (not shown).

The audio module 1380 can convert sound and an electric signalinteractively. At least some constituent elements of the audio module1380 can be included, for example, in the input/output interface 140illustrated in FIG. 1. The audio module 1380 can process, for example,sound information inputted or outputted through a speaker 1382, areceiver 1384, an earphone 1386, a microphone 1388, or the like.

The camera module 1391 is a device capable of taking a still picture anda moving picture. According to one embodiment, the camera module 1391can include one or more image sensors (e.g., a front sensor or rearsensor), a lens (not shown), an ISP (not shown), or a flash (not shown)(e.g., an LED or a xenon lamp).

The power management module 1395 can manage power of the electronicdevice 1300. Though not illustrated, the power management module 1395can include, for example, a Power Management Integrated Circuit (PMIC),a charging Integrated Circuit (IC), and a battery or fuel gauge.

The PMIC can be mounted, for example, within an integrated circuit or anSoC semiconductor. A charging method can be divided into wired andwireless. The charging IC can charge a battery, and can prevent theinflow of overvoltage or overcurrent from an electric charger. Accordingto one embodiment, the charging IC can include a charging IC of at leastone of a wired charging method and a wireless charging method. As thewireless charging method, there are, for example, a magnetic resonancemethod, a magnetic induction method, an electromagnetic method and thelike. The charging IC can be added with a supplementary circuit forwireless charging, for example, a coil loop, a resonance circuit, arectifier circuit or the like.

The battery gauge can measure, for example, a level of the battery 1396and a charging voltage, current or temperature. The battery 1396 canstore and generate electricity, and can supply a power source to theelectronic device 1300 using the stored or generated electricity. Thebattery 1396 can include, for example, a chargeable cell or a solarcell.

The indicator 1397 can display a specific state of the electronic device1300 or a part thereof, for example, a booting state, a message state, acharging state or the like. The motor 1398 can convert an electricalsignal into a mechanical vibration. Though not illustrated, theelectronic device 1300 can include a processing device (e.g., a GPU) formobile TV support. The processing device for mobile TV support canprocess, for example, standard media data of Digital MultimediaBroadcasting (DMB), Digital Video Broadcasting (DVB), a media flow orthe like.

The aforementioned constituent elements of an electronic deviceaccording to an embodiment of the present disclosure can be eachcomposed of one or more components, and a name of a correspondingconstituent element can be different according to the kind of theelectronic device. The electronic device according to the presentdisclosure can include at least one of the aforementioned constituentelements, and can omit some constituent elements or further includeadditional other constituent elements. Also, some of the constituentelements of the electronic device according to the present disclosureare combined and constructed as one entity, thereby being able toidentically perform the functions of the corresponding constituentelements before combination.

As described above, embodiments of the present disclosure can improve animage processing speed of an image processing unit (i.e., ISP) byinterlocking thumbnail data generated using a processor different fromthe image processing unit and capture data and storing the interlockresult in an electronic device.

The embodiments of the present disclosure can improve a processing speedfor thumbnail data by generating the thumbnail data using metadatagenerated in the image processing unit in a different processor of anelectronic device. Here, the metadata can include a frame identifier ofimage data, an image acquisition time stamp, focus information, imagesetting information (EXIF), flash information, and the like.

While the present disclosure has been shown and described with referenceto certain preferred embodiments thereof, it will be understood by thoseskilled in the art that operations of an electronic device can bechanged, merged or reused and various changes such as omission and thelike can be made therein without departing from the spirit and scope ofthe present disclosure. Therefore, the spirit and scope of the presentdisclosure should not be limited and defined to the describedembodiments and should be defined by not only the appended claims butalso equivalents to the appended claims.

What is claimed is:
 1. An electronic device comprising: a first imagesensor configured to generate a plurality of first image data; a secondimage sensor configured to generate a plurality of second image data;one or more first processors configured to: generate a preview image byprocessing at least one of the first image data and the second imagedata; in response to occurrence of capture event, select one among theplurality of first image data, and one among the plurality of secondimage data based on a processing delay of the first image data and thesecond image data; and synthesize at least a portion of a selected firstimage data and second image data as a capture image, a memory configuredto store the preview image and a metadata of the preview image; adisplay configured to display the preview image; and a second processorconfigured to generate a thumbnail data using at least part of thepreview image corresponding to the capture image and meta data stored inthe memory, in response to a signal corresponding to a captureinstruction, wherein the meta data includes at least one of an imageacquisition time stamp and frame identification information.
 2. Theelectronic device of claim 1, wherein the thumbnail data comprises animage of a resolution less than the preview image.
 3. A method in anelectronic device, the method comprising: generating a plurality offirst image data and a plurality of second image data using a pluralityof image sensors; converting at least one of the first image data andsecond image data into a format displayable on a display as a previewimage through one or more image signal processors; in response tooccurrence of capture event, selecting one among the plurality of firstimage data and one among the plurality of second image data based on aprocessing delay of the first image data and the second image data;synthesizing at least a portion of a selected first image data andsecond image data as a capture image; and generating a thumbnail datausing the preview image corresponding to the capture image and a metadata of the preview image in another processor separate from the imagesignal processors, in response to a signal corresponding to a captureinstruction, wherein the meta data includes at least one of an imageacquisition time stamp and frame identification information.
 4. Themethod of claim 3, further comprising generating a plurality of imagedata using the plurality of image sensors connected to the electronicdevice, or connected with the electronic device through a wiredinterface or a wireless interface.
 5. The method of claim 3, furthercomprising displaying on the display one or more image data among theconverted at least one of the first image data and second image data. 6.The method of claim 3, wherein converting the at least one of the firstimage data and second image data into a format displayable comprises:converting first image data generated using a first image sensor amongthe plurality of image sensors into the format displayable on thedisplay, using a first image signal processor formed in an ApplicationProcessor (AP); and converting second image data generated using asecond image sensor among the plurality of image sensors into the formatdisplayable on the display, using a second image signal processor formedseparately from the AP.
 7. The method of claim 3, wherein the convertingthe at least one of the first image data and second image data into aformat displayable comprises generating one or more preview data and oneor more metadata of the one or more preview data by converting theplurality of image data into the format displayable on the display. 8.The method of claim 3, further comprising: interlocking the thumbnaildata and a capture image data using the image acquisition time stampcomprised in metadata or the frame identification information, andstoring an interlock result in a memory.
 9. The electronic device ofclaim 1, wherein a size of the thumbnail data is less than a size of thepreview image.
 10. The electronic device of claim 1, wherein the firstand second image sensors are connected with the electronic devicethrough a wired interface or a wireless interface.